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(54) Full-scene antialiasing using Improved supersampling techniques 

(57) A method and an apparatus reduces aliasing 
artifacts in images defined by pixels. A pixel is parti- 
tioned into subpixel locations from which sample points 
are selected. A fragment of the image is determined to 
be visible at least one of thQ sample points. A fragment 
value associated with that fragment is stored. Each 
sample point at which the fragment is visible is linked to 
the stored fragment value. A color of the pixel is com- 
puted from the stored fragment values to reduce the 
aliasing artifacts in the image. 
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Description 

Field of the Invention 

[0001] This invention relates generally to computer 
graphics, and mare particularly to a method and appa- 
ratus for reducing aliasing artifacts in images defined by 
pixels. 

PackgroMDd 

[0002] In pixel-based display systems, visual artifacts 
such as jagged lines are due to an effect known as 
aliasing. Aliasing occurs because of the discrete nature 
of pixels, the smallest picture element addressable on a 
display screen. Pixels are arranged on a display screen 
as an rectangular array of points. Aliasing artifacts can 
occur when an entire pixel is given a light intensity or 
color based upon an insufficient sample of points within 
that pixel. Techniques to minimize aliasing artifacts are 
referred to as antialiasing. 

[0003] One antialiasing technique is supersampling, 
Supersampling involves taking more samples of an 
image than there are pixels to be displayed. Such sam- 
ples are taken at subpixel positions within each pixel. 
The color and intensity displayed for each pixel comes 
from combining the subpixel samples. 
[0004] The quality of the antialiasing obtained by 
supersampling is affected by the degree to which pixels 
are divided into subpixels, and the number of subpixels 
that are sampled for each pixel. Generally, the more 
subpixels per pixel, the finer is thB resolution of The 
image; and the more subpixels per pixel sampled, the 
better Is the antialiasing effect An 8 x a grid of subpixels 
offers four times as many possible sample locations 
than a 4 x 4 grid of subpixels Also, sampling all sixty- 
four subpixels of an 8 x 8 grid provides sixty-four times 
more pixel data than sampling only one erf the sixty-four 
subpixel sites. 

[0005J However, sampling at every subpixel position, 
referred to as full scene supersampling. is costly to 
implement Each subpixel sample requires memory, 
and consumes memory bandwidth. Also, the amount of 
computation needed to derive the displayed pixel value 
increases with the number of samples taken. Accord- 
ingly, the problems of full scene supersampling have led 
to sparse supersampling in which only a portion of the 
subpixel positions are sampled. In the 8 x 8 grid, for 
example, only eight of the sixty-four subpixels might be 
sampled to produce a display value for a pixel. 
[0006] Eight subpixel samples per pixel still take up 
considerable memory. If each pixel needs eight bytes 
per sample, then eight samples need sixty-four bytes. 
For a 1600 x 1200 pixel display, this would require 123 
Mbytes of memory. 

[0007] Thus, there is a need for a method and an 
apparatus that raducB the memory capacity and band* 
width requirements associated with prior art antialiasing 



techniques while effectively reducing aliasing artifacts m 
images. 

Summary of the Invention 

s 

[0008] This invention is tor the purpose of minimizir g 
aliasing artifacts in graphic images using improved 
supersampling techniques. The invention enables 'O 
effectively minimizB these artifacts while reducing the 

10 memory capacity and bandwidth requirements associ- 
ated with prior art antialiasing techniques. 
[0009] The present invention, in its broad farm, 
resides in a method, a memory, and an apparatus as in 
claims 1, 11, and 14 respectively for reducing aliasing 

is artifacts in an image defined by pixels. As describtri 
herein, the method, selects subpixel locations in a pUel 
as sample points. A fragment value associated with a 
fragment of the image is stored. This fragment covers 
one or morB of the selected sample poinre. Each ccv- 

20 ered sample point is linked to the stored fragment valt ie 
to enable the generation of a color of the pixel using the 
fragment value. The generated color improves the per- 
ceived quality of the image by reducing aliasing aid- 
facts. 

2$ [0010] Preferably an index is associated with ea;h 
covered samplB point, and a value stored in each index 
to point to the stored fragment value. 
[0011] Further, a bit pattern is associated with tile 
stored fragment value. Each bit in the pattern is assooi- 

30 ated with one of the sample points. A value is stored in 
each bit, indicating whether or not the sample pent 
associated with that bit is covered by the fragment. 
[0012] As described hereinafter, a new visible fre.g- 
ment is processed, and the stored fragment value is 

as replaced by the fragment value associated with the n**w 
fragment 

[0013] Advantageously, addresses of memory (ire 
allocated to tha pixel for storing a predetermined 
number of fragment values, the predetermined numrier 

40 being less than the number of sample points. 

[0014] In terms of the apparatus, the arrangemunt 
comprises a graphics device that selects subpixel posi- 
tions in a pixel as sample points, and a memory coupled 
to the graphics device. The memory stores a fragment 

as value associated with a fragment of the image. This 
fragment covers one or more of the sample points in ihe 
pixel. The graphics device linte each covered samole 
point to the stored fragment value to enable the genera- 
tion of a color of the pixel using the fragment valje. 

so When the pixel is rendered, the generated ccJor 
improves the perceived quality of the image by reducing 
aliasing artifacts. 

[001 5] In terms of a memory for storing data useel to 
compose a color tor a pixel that is partitioned into sub- 
ss pixels, the described arrangement comprises a plurality 
of addresses that each store a fragment value. Each 
stored fragment value includes a color value and is 
associated with a fragment of an image that covers one 
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of the subpixete. Another address stores a plurality of 
indices. Each index is associated with one of the sub- 
pixels and includes an index value that points to one of 
the plurality of addresses storing a particular fragment 
value to link the subpixel associated with that index with 
the color value of the particular fragment value. 

prief Description of th e Drawings 

[001 6] A more detailed understanding of the invention 
may be had from the following description of a preferred 
embodiment, given by way of example, and to be under- 
stood with reference to the accompanying drawing 
wherein: 

• FJG. i is a block diagram of an exemplary computer 
graphics system that can be used to practice the 
invention; 

• Figs. 2A-2C represent various subdivisions of a 
pixel into sub-pixels, and illustrate exemplary sparse 
supersampling patterns that can be used to sample 
the subp'nels; 

• FIG. 3 represents an exemplary linWng of subpixel 
samples in one of the supersampling patterns of 
FIG. 2A-2C to two fragment triples stored in a pixel 
memory; 

• FIG. 4 represents another linking of subpixel sam- 
ples for when a third fragment appears in a pixel; 

• FIG. 5A-5C illustrate alternative Unkings of subpix- 
els samples for when a third fragment appears in a 
pixel; 

• Figs. 6A-6B illustrate a logical representation of the 
pixel memory including indices to the stored frag- 
ment triples; 

• Figs. 6C-6D illustrate a logical representation of the 
pixel memory including coverage masks associated 
with the stored fragment triples; and 

• Fig. 7 illustrates a flow diagram describing an 
exemplary process using the present invention. 

DETAILED DESCRIPTION O F A PREFERRED. 
EMBODIMENT 

System Overview 

[001 7] FIG. 1 shows a computer system 1 00 that can 
generate monochrome or multicolor 2-dimensional (2D) 
and 3-dimensional (3D) graphic images for display 
according to the principles of the present invention. The 
computer system 100 can be one of a variety of raster 
graphics systems including, for example, a personal 
computer, a workstation, or a mainframe. 
[0018] In the computer system 100, a system chipset 
1 04 provides an interface among a processing unit 1 02, 
a main memory 106, a graphics accelerator 103 and 
devices (not shown) on an I/O bus no. The processing 
unit 102 is coupled to the system chipset 104 by the 
host bus 112 and includes a central processing unit 



(CPU) 1 18. The main memory 106 interfaces to the sys- 
tem chipset 104 by bus 1 1 4. 
[0019] The graphics accelerator 1 08 is coupled t? the 
system chipset 104 by a bus 1 16, by which the graphics 
b accelerator 108 can receive graphics commands to 
render graphical images. A graphics memory 122 iind a 
display device 126 are coupled to the graphics acceler- 
ator 108; the graphics memory 122 is coupled by bus 
124, and the display device 126, by bus 127. Tht; dis- 
io play device 126 includes a cathode ray tube (ZRT) 
raster display monitor 128 with a display surface or 
screen 130. The CRT 128 produces color images, but 
the Invention can also be practiced with a monochrome 
monitor to display gray-scale images or with a printer 
f 5 that prims black and white or color images. 

[0020] An image 132 appears on the display screen 
130 by illuminating a particular pattern of individual 
points called pixels 134. The image 132, for example, 
can be 2D alphanumeric characters or a 3D scene filled 
so with objects. The display screen 130 includes a two- 
dimensional array of such pixels 13*. The array sfce of 
display screens 130 can vary widely. Examples erf dis- 
play screen 130 sizes include 1024 x 768 and 1 320 x 
1200 pixels. For the purposes of practicing the inven- 
25 tion, the display device 126 may be any other pixel- 
based display such as a liquid-crystal display or a dot 
matrix printer. 

[0021] The graphics memory 122 includes storage 
elements for storing an encoded version of the graphical 
so image 132. There is a direct correspondence between 
the storage elements and each pixel 134 on the display 
screen 130. The storage elements are allocated to store 
data representing each pixel 134. hereafter referred to 
as pixel data. For example, five bytes may be uiied to 
as encode a color representation for each pixel. 

[0022] The values stored in the storage eleme its for 
a particular pixel controls thB color of the particular pixel 
134 on the screen 130. By "color", it is to be understood 
that the brightness or intensity of the pixel 134 Is also 
40 intended. Pixel data can translate directly into colors or 
into indices to access a color lookup table. 
[0023] During operation, the computer systen 100 
can issue graphics commands that request an object to 
be displayed. The graphics accelerator 108 executes 
the graphics commands, converting the object into 
primitives and then into fragments. A primitive is a 
graphical structure, such as a line, a triangle, a circle, or 
a surface patch of a solid shape, which can be used to 
build more complex structures. A fragment is a 21) poly- 
gon created by clipping a primitive of the image 132, 
such as a line, triangle, or circle, to the bounds ries of 
the pixel 134. A more detailed description of fragments 
is provided by Loren Carpenter in •The A-butter, an 
Antialiased Hidden Surface Method", Computer 3raph- 
$s ics Vol. 1B, No, 3, 1984, pp. 103-107, incorporated by 
reference herein. There, techniques merge fragments 
into a fragment list when the fragments are from the 
same object or surface of the image. Here, the frag- 
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merits that are combined to produce the color of a pixel 
can have a different relationship lo each other; that is, 
the fragments can be from different objects or surfaces 
of the image 132. 

[0024] The graphics accelerator 1 08 renders the frag- 
ments, and toads the pixel data corresponding to the 
Iragments into the appropriate storage elements of the 
graphics memory 1 22. The pixel data can be transferred 
into the graphics memory 122 from the main memory 
106 via busses 112, 114. 116, and 124, or written 
directly into the graphics memory 122 by the graphics 
accelerator 108. 

[0025] To display the image 132, the CRT monitor 1 28 
projects a beam onto the screen 130. In synchrony, the 
pixel data are read out of the graphics memory 122 as 
the beam scans the screen 130. The CRT monitor 128 
renders the pixel data as illuminated points of color on 
the display screen 130. 

[0026] Fig* 2A-2C illustrate various exemplary subdi- 
visions of a piffll 134. FIG. 2A shows pixel 134 divided 
into a 4 x 4 array 200 of evenly spaced points called 
6Ubpixels 206; FIG. 2B shows an 8 x 8 array 202 of sub- 
pixels 206; and FIG. 2C shows a 16 x 16 array 204. 
Dividing a pixel 134 into subpixels 206 provides multiple 
points at which the image 132 covering that pixel 134 
can be sampled. For reference, the center 201 of the 
pixel 134 is shown as an X. 

[0027] Generally, the more subpixels 206 there are in 
the array, the greater the resolution of the pixel 134. 
Thus, the displayed color of the pixel 134 does not rely 
entirely on one sample point, but upon several subpixel 
samples 206. Methods for calculating a pixel value from 
multiple sample points are wail known in the art 
[0023] Known implementations sampled at every sub- 
pixel 206 in a pixel 134. While, theoretically, such full 
scene supersampling presented opportunities for 
attaining high resolution, the technique unnecessarily 
consumed memory resources. Each sampled subpixel 
206 required memory resources to store and use the 
sampled data. Thus, fully sampling the 4 x 4 array 200 
of subpixels 206 required memory storage for sixteen 
samples, in addition to the typical memory requirements 
for each pixel 134. If the sixteen samples each required, 
for example, eight bytes of storage, then implementing 
full scene supersampling could require an additional 
295 MBytes of memory for a 1920 x 1200 pixel display 
screen 130. The 16 x 16 array 204, which requires stor- 
age for 256 samples, needs sixteen times as much 
memory. 

[0029] Accordingly, recent modern implementations 
do not sample at every subpixel 206. Rather, those sub- 
pixels 206 which are sampled are sparsely distributed in 
the subpixel array In general, the antialiasing results 
were almost as effective for such sparse supersampling 
as for the full scene supersampling technique. 
[0030] Figs. 2A-2C each illustrate an exemplary 
sparse supersampling pattern 210, 220, 230 that can be 
used to sample the subpixels 206 of the corresponding 



subpixel array. The illustrated exemplary sample pat- 
terns 210, 220, 230 each have N samples distrfcuted 
uniformly throughout an N x N subpixel array wilh 
exactly one subpixel sample in any particular row and in 

5 any particular column. 

[0031] The sampling pattern 210 has four subpixe s 
samples S1-S4 (N equals 4). For sampling pattern 220, 
N equals 8, and the eight subpixel samples 222 are S I- 
S8. For sampling pattern 230, N equals 16, and the si;<- 

10 teen subpixel samples 232 are S1-S16. The samplirg 
pattern 210, 220, 230 can be repeated for every pixel 
134 on the display screen 130. Various other samplir-g 
patterns can be used to practice the principles of the 
invention. 

is [0032] Although sparse supersampling uses le*s 
memory than full scene supersampling. considerable 
amounts of additional memory are still required. For 
example, when N equals 4, a 1920 x 1200 pixel scret-n 
130 still needs eight bytes storage for each of four su> 

20 pixel samples. This requires an additional 74 Mbytes of 
pixel data. The requirements are doubled and quadr> 
pled when N equals 8 and 16. respectively. 
[0033] The described arrangement can reduce the 
storage requirements even more than such spanie 

25 supersampling without reducing the number of subpb al 
samples for an N x N subpixel array. The arrangement 
described herein relies upon the observation that typi- 
cally only a few fragments of the image 132 are visible 
within a given pixel. 

30 [0034] For static and animated images, the antialias- 
ing effects achieved by eight sparse supersamples in 
the 8 x 8 array 202 appear significantly better than lor 
four samples in the 4 x 4 array 200. But differences 
between sixteen samples in the 16 x 16 array 204 and 

96 eight samples in the S x B array 202 may be indistin- 
guishable. 

[0035] FIG. 3 shows an exemplary pixel 300 that is 
part of the image 1 32 and is subdivided into a 4 x 4 sl b^ 
pixel array 200. The pixel 300 has four sampling posi- 

40 tions according to sampling partem 210 of FIG. 2A. Two 
fragments 301 , 302 are in pixel 300. Each fragment 3CH , 
302 is associated with a fragment value, called a frag- 
ment triple 310, 312. For example, in FIG. 3, fragmont 
triple 31 0 is associated with fragment 302, and fragment 

as triple 312 with fragment 301 . 

[0036] Fragment values are called fragment triples 
because each fragment triple 310, 312 includes three 
values: a color value 304, a Z-depth value 306. and a 
stencil value 308. The color value 304 represents Ihe 

so color and opacity of the corresponding fragment. The Z- 
depth value 306 represents a Z-coordinate value of Ihe 
corresponding fragment along a Z-axis that is perpen- 
dicular to the image 13210 provide 3D depth. The stun- 
cil value 308 can be used to group or identify sets of 

65 fragments of the image 1 32, or to logically or arithmeti- 
cally process or count operations upon fragments, or for 
other purposes known to those skilled in the art. 
[0037] In the preferred embodiment, the exemplary 
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fragmeni triples 310, 312 each use five bytes to repre- 
sent the oolor 304, three bytes tor the Z-depih 306 and 
one byte for the stencil 308. The five color 304 bytes 
accommodate four 1 0-bit color channels: Red, Green, 
Blue, and Alpha, 

[00381 The color of a fragment is expressed by the 
combination of the values stored in the Red, Green and 
Blue (RGB) channels. The value stored in each RGB 
channel indicates the intensity (or brightness) of that 
color channel. Low values correspond to low intensity, 
dark colors; high values correspond to high Intensity, 
light colors. Various methods for producing the color by 
combining the RGB values are well known in the art. 
[0039] The cpacHy of the fragment is expressed by the 
value stored in the Alpha channel. For example, a 1.0 
value (i.e., all 10 Alpha-channel bits are 1) indicates that 
the associated fragment \s opaque, a 0.0 value indi- 
cates that the fragment is invisible, i.e., completely 
transparent, and values between 0.0 and 1.0 Indicate 
degrees of transparency. 

[0040] Memory is allocated to each pixel 134 for stor- 
ing a predetermined number of fragment triples. This 
memory can be either graphics memory 122, as shown 
in FIG. 3, or main memory 106. In the example shown in 
FIG. 3, the pixel memory 314 is allocated for one partic- 
ular pixel 300. Conceivably, a group of pixels, like a 2 x 
2 array of pixels 134, can share a particular pixel mem- 
ory 314. Any fragment triples stored in the pixel memory 
314 would be used by each pixel 134 in the group, 
rather than by only one particular pixel 300. This can 
save more memory than storing a predetermined 
number of fragments for every pixel 134, particularly for 
portions of the image 132 that change color and Z- 
depth gradually. 

[0041] Alternatively, memory for storing fragment tri- 
ples can be dynamically allocated to each pixel 134 
rather than fixed to a predetermined number. Here, a 
variable number of fragment triples can be stored for 
each pixel 134, the graphics accelerator 108 allocating 
memory to the pixel 134 as needed, presuming there is 
still available pixel memory in the system 100. Another 
method combines aspects of both above-described 
methods, allocating memory to each pixel 134 for stor- 
ing a predetermined number of fragment triples, and 
dynamically allocating additional memory to a particular 
pixel 1 34 when needed to store a fragment triple beyond 
the predetermined number. 

[0042] The exemplary embodiment shown in FIG. 3 
stores two fragment triples 310, 312 in the pixel memory 
314. These fragment triples 310, 312 are associated 
with the fragments 301, 302 that cover the pixBl 300. 
BBfore the fragments 301, 302 appear in the pixel 300, 
the pixel memory 314 can be initialized to contain a 
default fragment value. The default vaJue represents a 
background fragment that can be used when no frag- 
ments cover a particular subpixel sample or when all 
fragments that cover the particular subpixel sample are 
transparent. Alternatively, this default fragment value 



can be stored in the graphics memory 122 wher<i the 
value can be shared by multiple pixels 134. Each pixel 
1 3d could store a special index value that pointed t o the 
default fragment 
5 [0043] Other embodiments can store more than two 
triples in order to improve the quality of the antialiasing. 
Storing few triples saves memory, but can prcduce 
lesser quality antialiasing than storing many triple*:. For 
instance, it is observed thai for the 8 x 8 subpixel array 
10 202 and the sampling pattern 220 (N=8), storing three 
triples produces bettor antialiasing results than sloring 
two triples. 

[0044] Pointers 320-326 link the subpixel samples S1 - 
S4 to the associated fragment triples 310, 312 sto ed in 
is the pixel memory 314. By link, what is meant is a logical 
association between the subpixel samples S1-S4 and 
the fragment triples 310, 312. As examples, pointer 326 
links subpixel S1 to fragment triple 312, while pointers 
320-324 link subpixels S2-S4 to fragment triple 31 0. 
zo [0045] In one embodiment, described further in con- 
nection with FIG. 6A, the linking is accomplish.ad by 
storing an index value for each subpixel sample S1-S4. 
Accordingly, this embodiment is coined indexed sparse 
supensampling. In another embodiment, descrited in 
25 connection with FIG. 6C, the linking is accomplished by 
storing a coverage mask, or bit pattern, for each Jitored 
fragment value. This embodiment is hereafter referred 
to as an Improved A-buffer technique. Collective y, the 
embodiments are referred to as improved supersam- 
30 pling techniques. 

[0046] To determine the color of the exemplar' pixel 
300, the graphics accelerator 108 uses one of tho pixel 
subdivisions 200, 202, 204 and a sampling patter ^ 210, 
220. 230 to 6ample the portion of the image 132 *Jver- 
36 Ing the pixel 300. For example in FIG. 3, the graphics 
accelerator 108 uses the 4 x 4 array 200 with the N = 4 
sampling pattern 210 to sample pixel 300. As Ehown, 
the fragment 301 covers subpixel sample SI, and the 
fragment 302 covers the three subpixels samplos S2- 
40 S4. A fragment covers a subpixel when the centei of the 
subpixel sample is within an area enclosed by th 3 frag- 
ment or, in certain cases, on an edge of the fragmeni. 
[0047] Generally, the graphics accelerator 108 deter- 
mines which fragments 301, 302 are visible at each 
4S subpixel sample S1-S4. From the perspective of a 
viewer of the image 132, which, for the purposes rrf illus- 
trating the invention is 3D, some fragments can be 
closer to the viewer and in from of other fragments. The 
closer fragments are referred to as foreground frag- 
so ments and the farther fragments, as background frag- 
ments. An opaque foreground fragment can occlude a 
background fragment behind that foreground fragment. 
[0048] Accordingly, each fragment must pa&s a Z- 
depth test at one of the subpixel samples S1 -S4, that is, 
sb the Z-value 306 of the fragment triple associated with 
that fragment must be smaller, i.e., closer from the per- 
spective of the viewer, than the Z-value 306 to - every 
other opaque fragment. II a fragment passes the Z- 
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depth test, then the graphics accelerator 108 stores the 
fragment trfale associated with the visible fragment in 
The pwel memory 314. 

[0049] When the fragment 301 , for example, is deter- 
mined to be visible at the subpixel sample S1 of the 
pixel 300 t the pointer 326 is generated linking that sub- 
pixel SI to the appropriate stored fragment triple 312. In 
the preferred embodiment, the pointer 326 is stored in 
the pixel memory 314 along with the fragment triples 
310, 312 associated with the pixel 300. 
[0D50] Rather than storing four fragment triples in the 
pixel memory 314. one for each of the four subpixel 
samples S1-S4, which would be done using typical 
supersampling techniques, the exemplary embodiment 
in FIG. 3 stores only two fragment Triples 310 f 312. 
Accordingly, it is possible to avoid storing redundant 
data for the pixel 300 because only one instance of the 
fragment triple 310 Is stored for the three subpixel sam- 
ples S2-S4, By so doing, the storage requirements tor 
fragment triples are considerably reduced. 
[0051 ] For example, if each fragment triple 310,312 
requires nine bytes of storage, then the improved super- 
sampling techniques use approximately eighteen bytes 
of memory per pixel fewer than typical supersampling 
methods. The improved supersampling techniques do 
use additional memory for storing the pointers 320-326, 
but this amount is small when compared to the memory 
saved by storing only two fragment triples 310, 312 for 
the four subpixel samples S1-S4. 
[00521 The memory savings increase when the pixel 
300 is subdivided into one of the larger subpixel arrays 
202, 204. With the 8 x 8 subpixel array 202 and the sam- 
pling pattern 2Z0 (N equals 8), the improved supersam- 
pling techniques use fifty-four fewer bytes per pixel than 
typical supersampling. This is because only two of eight 
sampled fragment triples are stored in the pixel memory 
314. For the 16x16 subpixel array 204 and the sam- 
pling pattern 230 (N equals 16), only two of sixteen 
sampled fragment triples are stored in the pixel memory 
314, and so 112 bytes per pixel are saved. For a display 
screen 130 with 1920 * 1200 pixels, such savings 
amount to approximately 258 Mbytes. 
10053] The displayed color of the pixel 300 depends 
upon which filtering function Is used to combine the 
fragment triples associated with the four subpixel sam- 
ples S1 -S4. One function is simply to average the colors 
of the fragment triples associated with the four subpixels 
samples S1-S4, 

[0054J FIG. 4 illustrates an exemplary case in which a 
third visible fragment 4O0 appears in the pixel 300 of 
FIG. 3. As indicated by an arrow 402, the third fragment 
400 is linked to a new fragment triple 41 0. The new frag- 
ment triple 410 is different from the stored fragment tri- 
ples 310, 312. 

[0055J In this example, the third fragment 400 
occludes a portion of fragment 302 and is visible at sub- 
pixel sample S4. The fragment 301 is still visible at the 
subpixel Si , as is fragment 302 at thB subpixels S2-S3. 



Accordingly, the 6Ubpixel sample S1 remains linted 1o 
the fragment triple 312 by the pointer 326. Subpixels S2 
and S3 remain linked to the fragment triple 310 by the 
pointer 324 and pointer 322, respectively. To illustrate 
5 that the fragment 302 is no longer visible at the subpix j| 
sample S4, the link 320 from the subpixel sample S4 10 
the fragment triple 310 is shown as broken. 
[0056] When the third fragment 400 is processed kiy 
the graphics accelerator 108. the fragment triples 310, 
10 312 are already stored in the pixel memory 314, and the 
fragment triple 410 is shown as not yet being stored in 
the pixel memory 314. Described below are various 
ways to handle the third fragment triple 410. 
[0057J FIG. SA shows one technique for handling trie 
is third visible fragment 400 in the pixel 300, that is, to 
store the corresponding fragment triple 410 in the pixel 
memory 314, along with the other fragment triples 31 o, 
312. This technique presumes either that the memory 
314 allocated for the predetermined number of fragment 
20 triples can accommodate the additional fragment triple 
410 or thai the memory 314 needed for storing the n*iw 
fragment triple 41 o can be dynamically allocated. 
[0058] A drawback to storing additional fragment tri- 
ples in the pixel memory 314 \b that the amount of stor- 
es age needed for the improved supersampling methoJs 
approaches or even exceeds that of typical sparse 
supersampling. Should a fourth fragment be visible in 
the pixel 300, then, in the example of the 4 x 4 subpixel 
array, the improved supersampling methods and sparse 
so supersampling would each store four fragment tripltis. 
But for the larger subpixels arrays, such as the 8 x 6 
array and 16 x 16 array, there is still a strong likelihood 
that there are fewer visible fragments in the pixel 300 
than subpixel samples, and thus a corresponding sav- 
ss ings of memory remains. Further, when pixel memory 
314 is dynamically allocated beyond the predetermined 
number of fragment triples, in general, relatively few pix- 
els will need dynamically allocated storage Although 
improved supersampling methods might then require 
to more storage for a given pixel 134 than typical spaise 
supersampling, the improved methods might use I ess 
storage for the entire image 132 overall. 

ADAPTIVE PROCESS 

as 

[0059] Alternatively, an adaptive process can reduce 
the number of subpixel samples at which to sample tie 
pixel 300 when the number of visible fragments in the 
pixel 300 exceeds the available storage for fragment tri- 
50 pies, such as whBn the pixel memory 314 allocated for 
the predetermined number of fragment triples is already 
filled, or no pixel memory is available to dynamically 
allocate for the new fragment triple 410. 
[0060] For example, if there Is storage for only \wo 
as fragment triples, but there are four different visible frag- 
ments in the pixel 300 F a different fragment for each of 
the four subpixel samples S1-S4, then backing off to 
only two subpixel samples will ensure sufficient storage 
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for the Iragmenls covering those two samples. 
[0061 J The backing off on the number of samples can 
be gradual, For example, rf eight subpixel samples S1- 
S8 are used, then the process could start with eight 
samples, reduce to sii, then tour, and eventually to two, 
as the number of different visible fragments appear in 
the pixel beyond the available storage. 
[0062] The process can operate independently upon 
each pixel. For example, the process may use all four 
subpixel samples S1-S4 for one pixel, and back off to 
only two subpixel samples Si *S2 for another pixel. 
[0063] FIG. SB illustrates still another approach far 
handling the third visible fragment 400 in the pixel 300, 
that is. to blend the corresponding fragment triple 410 
with the other fragment triples 310, 312 stored in the 
pixel memory 314. The circled plus signs (V) in FIG. 
5B illustrate the blending process. 
[0064] An exemplary blending process weights the 
color contribution of each fragment triple 310, 312 and 
the new fragment triple 41 0 to the blended fragment tri- 
ple 530, 532. 

[0065] For example, the color contribution of each 
stored fragment triple 310, 312 is determined by multi- 
plying the color value 304 of that fragment triple by the 
number of samples still covered by that fragment triple; 
then by dividing thB result by thB number of samples S1 - 
S4 previously covered by that fragment triple before the 
new fragment 400 appeared. The color contribution of 
the new fragment triple 410 is obtained by multiplying 
the color value 304 of the new fragment triple 41 0 by the 
number of samples covered by the stored fragment tri- 
ple, but now covered by tfie new fragment 400; then by 
dividing the result by the number of samples S1 -S4 pre- 
viously covered by the stored fragment triple 310, 312 
before the new fragment 400 appeared. 
[0O66] Here, the fragment triple 310 would contribute 
2/3 of its color value 304 to the blended fragment triple 
530, and the new fragment triple 410 would contribute 
1/3 of Its color value 304- For the blended fragment tri- 
ple 532, the fragment triple 312 contribute all of its color 
value (1/1), and the new fragment triple 410, which cov- 
ers no sample points associated with the fragment triple 
312, would contribute none of its color value (0/1). 
Then, these weighted color values 304 are added. 
Other color blending techniques that are known in the 
art can be used. 

[0067] In FIG. SB, the fragment triple 410 is blended 
with fragment triple 310 to produce a blended fragment 
triple 530, and the pointers 322, 324 finking subpixels 
S2-S3 to the fragment triple 310 now point to the 
blended fragment triple 530. Also, fragment triple 410 is 
blended with fragment triple 312 to produce a Wended 
fragment triple 532. and the pointer 326 llnWng subpixel 
S1 to fragment triple 31 2 now point6 to the blended frag- 
ment triple 532. Subpixel S4 is linked to the blended 
fragment triple 530, Alternatively, the subpixel S4 can 
be linked to the other fragment triple 532. 
[0068] The blended fragment triples 530, 532 are 



stored in the pixel memory 314. Trie blended fragment 
triple 530 occupies the memory addresses previously 
occupied by the fragment triple 310. The address^ of 
pixel memory 314 that previously stored the fragrant 
5 triple 312. now 6tores the blended fragment triple £32, 
[0069] FIG. 5C shows an exemplary approach for 
accommodating the third visible fragment 400 in the 
pixel 300. This approach replaces one of the fragment 
triples 310. 312 previously stored in the pixel memory 
w 314 with the third fragment triple 410. For example, the 
fragment triple 310 is replaced by the new fragment tri- 
ple 410. To execute this replacement the graahics 
accelerator 108 would write the data of the new frag- 
ment triple 410 over the data of the previously stored 
is fragment triple 310, In effect, discarding the data of frag- 
ment triple 310. Alternatively, memory can be deallo- 
cated for the fragment triple 31 o r and allocated for 
fragment triple 410. 

[0070] In FIG. 5C, the data of the new fragment triple 
20 410 occupies the particular addresses of pixel me mory 
314 that previously stored the fragment triple 310. The 
pointers 322, 324 point to these particular addresr.es of 
pixel memory. Where previously the pointers 322. 324 
linked the subpixels S2-S3 to the fragment triple 310, 
25 these pointers 322, 324 now link the subpixels S2 S3 to 
the new fragment triple 410. 

[00711 Techniques for selecting which fragment triples 
310, 312, or 410 is discarded are described below. 



30 ^election Schemes: 
Z-piiority 

[0072] One technique for selecting the f ragmen ; triple 
35 310, 3i2 to replace, called the Z-priorhy method, is to 
determine which fragment triple 310, 312 stored in the 
pixel memory 314 has the largest Z-depth valuu 306. 
From the perspective of a viewer, the greater the Z- 
depth value 306, the farther is the corresponding frag- 
ao ment from the viewer. For example, If the Z-depth value 
306 of the fragment triple 31 0 is 4 and the Z-depth value 
306 of the fragment triple 312 is 2, then fragment triple 
310 is replaced by the new fragment triple 410. The 
pointers 322-324 that previously linked subpixei sam- 
45 pies S2-S3 to the fragment triple 3 1 0 now link th a sub- 
pixel samples to the fragment triple 410. In the event 
that more than one stored fragment triple 310, 3 12 has 
the largest Z-depth value 306, the fragment triple 310, 
312 with the fewer pointers 320-326 can be replaced. 

so 

Basic Color Difference 

[0073] Another technique for selecting which fragment 
triple 310, 312 to replace, called the basic coloi diffar- 
ss ence method, involves determining which fragrrent tri- 
ple 310. 312 stored in the pixBl memory 314 has a color 
value 304 that is most like the color value 304 of tie new 
fragment triple 410 i.e., produces the smallest color dif- 
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ference. The color value 304 of the new fragment triple 
410 is compared with the color value 304 of each stored 
fragment triple 310, 312. Although described below 
using the RGB color model, this method can be applied 
to other color models, such as the Hue f Lightness and 
Saturation (HLS) and the Hue, Saturation and Value 
(HSV) color models. 

[0074] More specifically, the basic color difference 
method compares the 10-bit value for the RED channel 
of the new fragment triple 410 with the 10-bit value for 
ihe RED channel of each stored fragment triple 310, 
312. Comparisons are also made for the GREEN and 
BLUE channels. Values in the Alpha channels are not 
compared. 

[0075] The absolute values of the differences between 
the valuBs of the channels of the new -fragment triple 
410 and the values of the channels of the stored frag- 
ment triples 310, 312 are summed. Then, The sum is 
multiplied by the number of subpixel samples that point 
to the stored fragment triple 310, 312. This produces a 
total color difference that would result if thai stored frag- 
ment triple 310, 312 were replaced by the new fragment 
triple 410, The fragment triple 310, 312 that produces 
the smaller color difference is replaced by the new frag- 
ment triple 410. 

[0076] Using an overly simplified example with refer- 
ence to FIG. 5C, the fragment triple 310 has a RED 
value of 0, GREEN value of 2, and a BLUE value of 4; 
the fragment triple 31 2 has a RED value of 2, a GREEN 
value of 4, and a BLUE value of 0; and the new fragment 
triple 410 has a RED value of 0, a GREEN value of 3. 
and a BLUE value of 3. Also, as shown in FIG. SC, there 
are two subplxels pointing to the fragment triple 310 » 
when the new fragment 400 is determined to be visible 
at sample point S4, the pointer 3Z0 {see FIG. 3) from S4 
to fragment triple 310 is Invalidated - and one subpixel 
pointing to the fragment triple 312. 
[0077] The total color difference between fragment tri- 
ple 310 and new fragment triple 410 is 4, e.g., ( |0-0| + 
|2-3| + |4-3| ) * 2, and the total color difference between 
fragment triple 312 and new fragment triple 410 is 6, 
e.g., ( |2-0| + (4-3| + 10-3| ) * 1. Thus, the fragment triple 
310 is therefore replaced. 

Color Difference and Transparent Fragments 

[0076J When transparent fragments are involved in 
color difference, the impact of each possible replace- 
ment upon the final pixel color is compared to the ideal 
final pixel color that would result when the new fragment 
triple 41 o could be stored in the pixel memory 314. That 
stored fragment triple 310, 312, which produces a final 
pixel color with the smallest color difference when com- 
pared to the Ideal final pixel color, is selected for 
replacement. In a stack of transparent fragments, this 
selection tends to replace the more distant transparent 
fragments that are hard to see. 



N Squared Color Difference 

[00791 In addition to comparing the new fragment u I- 
ple 410 with each stored fragment triple 310, 312, as s 

5 done In the color difference method, the N-squared 
color difference method compares each stored fratj- 
ment triple 310, 312 against each other. This melhcd 
either replaces one of the stored fragment triples 310 
with the new fragment triple 410, or replaces one of the 

10 stored fragment triples 310, 312 with another of the 
stored fragment triples 310, 312, i.e., by changing the 
pointers from the one stored fragment triple to that oth»*r 
stored fragment triple. The new fragment triple 410 is 
written at the addresses of pixel memory where trie 

75 replaced fragment triple was previously stored. The H- 
squared color difference does not appear to perform 
signif icantly better than the color difference process. 

Visual Sensitivity Color Difference Methods 

20 

[0080] Other techniques that may yield satisfactory 
results rely on the characteristics of the human visual 
system. Far example, the ability of a human eye to dis- 
tinguish changes in brightness may be less than the 

26 ability to perceive changes In hue. AccorcSngly, ;in 
exemplary visual sensitivity replacement scheme can 
capitalize on this characteristic by replacing the frag- 
ment triple 310, 312 that is brighter or dimmer than Hie 
new fragment triple 410 instead of the fragment triple 

30 310, 312 that has a different hue, Such a method would 
prefer to replace the stored fragment triple 31 0, 31 2 w th 
a color value 304 that differs equally, or almost equally, 
in each of the RGB color channels from the color value 
304 of the new fragment triple 41 0, 

$5 [OuSl] Another exemplary technique can rely on tne 
logarithmic behavior of luminance perception in 
humans. In general, a human eye can detect, approxi- 
mately, a 2% change in the brightness of a color. Con- 
sequently, large numerical differences between high 

40 cola values 304 (i.e., colors of high Intensity) can be 
less noticeable than small numerical differences 
between low color values (I.e., colors of low intensity). 
So luminance differences are computed as ratios of 
color values 304, rather than as numerical dtfferenc es 

45 between color values. The fragment triple 31 0, 31 2 that 
produces the lower luminance differences, i.e., the 
smaller ratio of colors, when compared to the new frng- 
ment triple 410 is replaced. 

so Z-priority Color Difference 

[0082] This technique combines the Z-priority method 
with any of the above mentioned color difference meth- 
ods to produce a replacement scheme that can perform 
55 better than any of the methods alone. The abo/e- 
described color difference methods operate to replace a 
stored fragment triple with the new fragment triple. 1>ie 
Z-priority Color Difference method considers additiDn- 
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ally whether one of the stored fragment triples 310, 312 
should instead replace the new fragment triple 410. 
[0083] Here, the method computes color differences 
between the new fragment triple 410 and each stored 
fragment triple 310. 312 that may replace the new frag- 
ment triple 410. These color Differences are computed 
for each of those stored fragment triples That are in front 
of the new fragment i.e., lower Z-depth value, but not for 
those stored fragment triples that are behind the new 
fragment. 

[00841 Accordingly, a stored fragment triple 310,312 
may be selected to replace the new fragment triple 410 
when that fragment triple 310, 312 produces the small- 
est color difference and that fragment triple 310, 312 is 
associated with a fragment that is in front of the new 
fragment. In this case, replacement means that each 
subpixel sample covered by the new fragment are linked 
to the selected stored fragment triple 310, 312, and the 
new fragment triple 410 is discarded. 
[0085] In general, if more ttian one replacement is 
possible, then the replacement affecting the fewer 
number of subpixel samples should occur. For example, 
if either the new fragment triple or a stored foreground 
fragment triple can be replaced, then the stored frag- 
ment triple replaces the new fragment triple if the stored 
foreground triple covers more subpixel samples than 
the new fragment triple. 

Area Coverage 

[0086] Another effective process selects the fragment 
triple that is visible at the fewest number of subpixel 
samples, and replaces that fragment triple wrth the new 
fragment triple 410. Afterwards, each pointer to the 
replaced fragment triple points to the new fragment tri- 
ple. 

Semaphore Process 

[0087] The Z-priority Cdor Difference method allows 
existing foreground fragments to replace new back- 
ground fragments, but does not allow existing back- 
ground fragments to replace new foreground fragments. 
This is done to avoid losing large foreground surfaces 
that are made up of small foreground fragments - the 
large surface could be lost if the process allowed each 
of the small foreground fragments to be replaced by a 
larger background fragment. The Semaphore Process 
also avoids this problem. 

[0088] The Semaphore Process associates a sema- 
phore bit with each pixel. Initially, each semaphore bit is 
set to 0. If it is determined that replacing a new fore- 
ground fragment with an existing background fragment 
produces a smallest cola difference, and the associ- 
ated semaphore bit is 0, then the semaphore process 
allows the existing background fragment to replace the 
new foreground fragment The associated semaphore 
bit is set to 1 . This ensures that two such replacements 



cannot occur consecutively. If the replaced new fore- 
ground fragment was part of a larger foreground sur- 
face, then the next new foreground fragment for that 
larger surface will replace the existing background frag- 
ment because the semaphore bit is a 1 . However, h was 
observed that this basic semaphore process can pro- 
duce some unsatisfactory artifacts. 

Fragment Centroid Distance Methods 
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[0089] Such methods base color replacement on the 
distance between the new fragment and each possible 
fragment that the new fragment can replace. Accord- 
ingly, a new fragment can be extended to cover adj went 
ts subpixel samples rather than replace stored fragments 
that cover distant subpixel samples. Further, it is likely 
.that subpixel samples near the covered subpixel sam- 
ples will later become covered. 
[0090] Figs. OA and 6B illustrate a exemplary logical 
20 representation of the pixel memory 31 4 used by the 
indexed 6parse supersampling technique. The pixel 
memory 314 includes indices 600 and fragment mples 
310, 312. The pixel memory 314 provides storagn for a 
predetermined number of fragment triples. AHhough 
25 shown to be contiguous In the graphics memory 122, 
the indices 600 can be separate from each other or from 
the fragment triples 310. 312. 
[0091] The indices 600 indicate where in tht; pixel 
memory 31 4 the fragment triple associated with each 
30 subpixel sample can be found. Each index 602-15O8 of 
the indices 600 is associated with one of the 6L.bpixel 
samples S1-S4. For example, as shown in FK3. 6B, 
index 602 is associated with subpixel sample Si, index 
604 is associated with subpixel sample S2, and 60 forth. 
3S For the sampling pattern 220, there arB eight indices for 
the eight subpixel samples S1-S8, and for sampling pat- 
tern 230, where N = 1 6. there are sixteen. 
[0092] The value stored in each index 602-608 points 
to one of the fragment triples 310, 312. Accoidingly, 
40 each index 602-608 links the associated subpixel sam- 
ple S1-S4 to one of the fragment triples 310, 312. 
[0093] When two fragment triples 3 10, 312 arestored 
in the pixel memory 31 4, then each index 602-608 can 
be represented by one data bit The bit value stored in 
4s each index 602-608 directs the graphics acalerator 
108 to the fragment triple 3l0 t 312 associated wHh each 
subpixel sample S1-S4. In the example shown n FIG. 
6B, a T is stored in index 602, and a "0" in each of the 
other indices 604-608. A zero bit value points to ihe first 
eo fragment triple 31 0 in the pixel memory 31 4, and a one 
bit value points to the second fragment triple 31 ?!. 
[00941 If. alternatively, there are three fragmen; triples 
stored In thB pixel memory 314, then two bits per index 
602-608 are needed. Two bits per index 602-608 can 
55 accommodate as many as four stored fragment triples, 
three bits, as many as eight triples, and four ^its, as 
many as sixteen. 

[0095] With one bit per index 602-608. the sampling 
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pattern 210 [N=4) needs four bits of pixel memory 31* 
to implement the indices 600. The storage requirements 
for indices 600 of larger sampling patterns 220, 230 is 
also small. For example, the sampling pattern 230 (N = 
16) would need 16 bits per pixel 134 to implement one 
bit per index, Implementing tour bits per index uses 64 
bits per pixel, which still provides a sizable storage sav- 
ings over typical sparse supersampling techniques thai 
store sixteen fragment triples for the sixteen subpixBls 
samples S1-S16. 

[0096] To compute a color for the pixel 300, the color 
value 304 of each stored fragment triple 310, 312 is 
multiplied by the percentage of subpixel samples linked 
by an index to that fragment triple. Then these weighted 
color values are added together to produce the pixel 
color. 

[0097] Figs. 6C and 6D illustrate an exemplary logical 
representation of the pixel memory 314 used by the 
improved A-buffer technique. The pixel memory 314 
includes coverage masks (or bit patterns) 620, 622 and 
stored fragment triples 310. 312. The pixel memory 314 
provides storage for a predetermined number of frag- 
ment triples. Although shown to be contiguous in the 
graphics memory 122, The coverage masks 620. 622 
can be separate from each other or from the fragment 
triples 310, 312. An alternative embodiment including a 
third coverage mask 624 and the third stored fragment 
triple 410, is illustrated in Figs, 6C and 6D with dashed 
lines. 

[0098] The coverage masks 620, 622 link the subplxel 
samples S1-S4 to the fragment triples 310, 312 stored 
in the pixel memory 314. There is one coverage mask 
620, 622 associated with each stored fragment triple 
310, 312. Referring io FIG. 6D, the coverage mask 620 
is associated with fragment triple 310, for example, as 
indicated by arrow 621, and the coverage mask 622 is 
associated with fragment triple 312 as indicated by 
arrow 623. In the illustrated alternative embodiment, the 
coverage mask 624 is associated with the third frag- 
ment triple 410 by arrow 625. 
[0099] Each coverage mask 620, 622, 624 includes 
one bit for each subpixel sample S1-S4. In FIG, 6D, the 
associations between the bits in the coverage masks 
and the subpixel samples S1-S4 are represented by 
arrows 634-540. For example, subpixel sample S1 is 
associated with bits 626, subpixel sample S2 with bits 
628, sample S3 with bits 630 and sample S4 with bits 
632. 

[0100] With one bit per sample S1-S4, thB sampling 
pattern 210 (N=4) needs four bits 626, 62B, 630. 632 of 
pixel memory 314 to implement each coverage mask 
620, 622, 624. In the shown alternative ernbodment, in 
which three fragment triples are stored, the combined 
requirement for the three associated coverage masks 
620. 622, 624 is twelve bits. 

[0101] For the sampling pattern 220, each coverage 
mask 620, 622, 624 requires eight bits, one for each of 
the eight subpixel samples S1-SB. Ae for the sampling 



pattern 230, which has sixteen subpixel samples Si- 
S16, There would be sixteen 6uch bits in each coverage 
mask. Yet even witti 16 bits per coverage mask, the sto - 
age savings are sizable over known sparse supersani- 

5 pling techniques that store sixteen fragment triples for 
the sixteen subpixels samples S1 -516. 
[0102] The value stored in each bit of a given cover- 
age mask indicates whether the subpixel sample asso- 
ciated with that bit is linked to the fragment tripe 

io associated with the given coverage mask. When a san l- 
pte is linked to a fragment triple, this means that the 
fragment associated with that fragment triple is visible .at 
that sample. 

[01 03] In the example shown in FIG. 6D, a bit pattern 

is "0 1 1 1* is stored in the coverage mask 620. The T 
value in bits 628, 630 and 632 of the coverage mai;k 
620 link the subpixel samples S2-S4 to the stored frag- 
ment triple 310, indicating that the fragment 302 is visi- 
ble at those sample points S2-S4. Conversely, the '3" 

20 value in bit 626 of the coverage mask 620 indicates th at 
the fragment 302 is not visible at the subpixel sample 
S1 . Clearly, the role of each bit value can be reversed ;>o 
that the T bit value indicates that the fragment is not 
visible at a given sample point, and that the "0" bit value 

25 indicates that. the fragment l6 visible. 

[0104] In the alternative embodiment shown in FI<3. 
6D. a third coverage mask 624 links the subpixel sample 
S4 to the third fragment triple 410 stored in the pixel 
memory 314. The association between the third covor- 

so age mask 624 and the third fragment triple 41 o is noted 
by arrow 625. 

[0105] The exemplary bit pattern stored in coverage 
mask 624 is "0 001 n . indicating that the third f ragrruint 
400 is visble at sample S4 only. Recall from FIG. 4 that 

as new fragment 400 is linked to the fragment triple 4'0. 
For the purposes of the following illustration example, 
the third fragment 400 is treated as transparent. (Note 
that if the third fragment 400 was opaque, as described 
in connection with FIG. 4, then the bit pattern in the aw 

40 erage mask 620 would change from "0 1 1 1" to "0 1 
0* to indicate that the fragment 400 occluded the frag- 
ment 302 at the subpixel sample S4.) 
[01 06] Because the third fragment 400 is transparent, 
two coverage masks 620, 624 link the subpixel sample 

4S S4 to two stored fragment triples 310, 410. The "V bit 
values in bit positions 632 of the coverage mask 620 
and 624 indicate that both fragments 302 and 400 are 
visible at the subpixel sample S4. Generally, any sub- 
pixel sample S1-S4 can be linked to multiple steed 

sq fragment triples, where one fragment is opaque cind 
each other fragment is transparent In fact, all of stored 
fragment values can be transparent when a default 
background fragment value is used. 
[0107] Accordingly, the Improved A-buffer technique 

55 described herein can support order-independent trans- 
parency, i.e,, the system 100 does not need to parti' ion 
primitives of the image 132 so as to present transpai ent 
fragments to the graphics accelerator 108 after presont- 
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ing all opaque fragments, nor does the system 100 
need to sort the transparent primitives so as to present 
transparent fragments in Z-depth order. 
[0108] To compute the color of the pixel 300, a color is 
first computed for each subpixel sample S1-S4, and 
then the computed colors are combined. Where a sub- 
pixel sample is linked to onB opaque fragment only, 
such as sample. S1, the color for that subpixel 6ample 
S1 is the color of the associated stored fragment value 
312. 

[01 09] Where a subpixel sample, such as sample S4. 
is linked to two stored fragment triples 310, 410. one 
transparent 400 and the other opaque 302, the color for 
the subpixel sample S4 is the sum gf the color contribu- 
tions of those two fragment triples 310, 410. The color 
contribution of the transparent fragment 400 is the 
opacity of that fragment 400, as indicated by the value 
stored in the Alpha channel, multiplied by the color of 
that fragment 400. The contribution C of the opaque 
fragment 302 is trie color of that fragment f(c) 302 multi- 
plied by 1 minu6 the opacity of the transparent fragment 
f(o). 400, e.g„ C => «c) x (i • f(o)) . 
[0110] The exemplary embodiments shown in Figs, 
6A-6D can achieve satisfactory antialiasing results by 
storing two fragment triples for four subpixel samples. 
Eight subpixel samples with two stored fragment triples 
usually looks better than four subpixel samples with two 
fragment triples, but can look worse when one of the 
additional four subpixel samples requires replacing one 
of the stored triples with a third fragment triple, and that 
third fragment triple appears in the pixel memory last 
Thus, allocating storage for a third fragment triple can 
make a marked improvement for eight subpixel samples 
over storing two fragment triples. Clearly, the antialias- 
ing results can be made to approach the results of typi- 
cal sparse supersampling as more fragment triples are 
stored, but each additional triple erodes the memory 
savings provided by the improved supersampling tech- 
niques. 

[0111] Fig. 7 illustrates aflow diagram 700 describing 
the process of generating an image 132 using the 
present invention. In the early stages of processing the 
image 132, the image 132 is partitioned into fragments. 
When processing each new fragment, the graphics 
accelerator 108 determines whether the new fragment 
is visible at any of the subpixel samples S1-S4 covered 
by the new fragment The graphics accelerator 108 
compares the Z^epth value of the new fragment with 
the Z-depth value of the stored fragment associated 
with each covered subpixel sample S1-S4 (step 702). 
[0112] If the new fragment has a smaller Z-depth 
valUB than the Z-depth value of a stored fragment for 
any covered subpixel sample S1 -SA, then the new frag- 
ment is in front of that stored fragment and, conse- 
quently, is visible. An exception, however, is when the 
new fragment has an Alpha value of 0.0. In this instance 
the new fragment is completely transparent The graph- 
ics accelerator 108 does not need to store the fragment 



value of the new fragment because the new f ragme nt is, 
in effect, invisible. 

[0113] If instead the new fragment has a largar Z- 
depth value than the Z<Jepths values for all of the cov- 

5 ered subpixel samples S1 -S4, then the new fragment is 
behind one or more stored fragments and may be nvis- 
ible. If the new fragment is behind opaque foreground 
fragments, then the new fragment is invisible, ani the 
processing of the new fragment for the pixel 1 34 is com- 

w plete. If, however, the new fragment is immediately 
behind a transparent foreground fragment, then thn new 
fragment can still be seen. 

[0114] When the new fragment is visible at one of the 
covered subpixel samples, then the graphics acculera- 

is tor 108 invalidates the link between each covered sam- 
ple and a stored fragment, if the new fragment obscures 
the stored fragment for that covered subpixel sa-nple. 
For the indexed sparse supersampling technique, the 
graphics accelerator 108 maintains control bits for <eep- 

20 ing track of the validity of each index and invalidates 
each index linking a covered subpixel sample to an 
obscured fragment. The control bits may direct the 
graphics accelerator 108 to use the default background 
color if no fragments cover a subpixel sample. For the 

25 improved A-buffer technique, the bits in the coverage 
mask associated with each covered subpixel siimple 
are unchanged when the new fragment is transparent 
and are set to "O'" when the new fragment is opaq je. 
[0115] Than, in step 708. the number of links pointing 

3o to each fragment triple is counted. For the indexed 
sparse supersampling technique, step 708 counts the 
number of indices linked to that stored fragment triple. 
For the improved A-buffer technique, step 708 counts 
the number of bits in each coverage mask that have a 

35 "1 " bit value. 

[01 16] A fragment triple is free and available when 
there are no links pointing to the fragment triple. In this 
case a new fragment triple associated with tho new 
fragment can replace that free fragment triple. 

40 [01 17] If step 710 determines that a fragment ti iple is 
free, then the new color associated with the nev/ frag- 
ment is stored in the freed fragment triple (step 7 12). In 
step 714, the links of the subpixel samples cove ed by 
the new fragment are set to the new fragment triple. 

45 [0118] If step 710 determines that no fragment triples 
are free, then a replacement scheme, such as tho color 
difference technique described above, selects one of 
the stored fragment triples for replacement (step 716). 
Replacement means changing the color, Z-deptn, and 
so stencil values stored in the selected fragment triple to 
the color. Z-depth, and stencil values of the new frag- 
ment triple. 

[0119] In step 718, the new color is written to the 
selected fragment triple. Ttie links originally poirling to 
55 the selected fragment triple are still pointing to that frag- 
ment triple. Because the selected fragment triple now 
contains a value representing the new color, the sub- 
pixel samples associated with such links are tnereby 
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associated with the new color. Those finte correspond- 
ing to the subpixel samples covered by the new frag- 
ment are set to point to the new color (step 714). 
[0120] In step 720, the pixel color is computed from 
the subpixel samples as described above in connection 
with Figs. 6A-6D. The links associated with the subpixel 
samples S1-S4 point to the stored colore that are used 
to produce the color of the pixel 134. Accordingly, the 
pixel color can change as each new fragment appears 
in the pixel 134. 
[0121] When, in step 722. the graphics accelerator 
108 is through processing all fragments, then the pixels 
are ready for display (step 724) . 
[01 22] In FIG. 7, an alternative process for generating 
an image computes the color ol the pixel in step 720', 15 4. 
illustrated as dashed lines, before determining whether 
there are any fragment triples available in which to store 
the new fragment value associated with the new frag- 
ment. The existing colors stored in the fragment triples 
and the new color value combine to produce the pixel so 
color. The effect is to compute the color as Though an 
additional triple was available. 
[01 23] After computing the pixel color in step 720', the 
alternative process may then replace an existing stored 
color with the new fragment triple as described above in ss & 
connection with the steps 716-718. If each fragment 
processed after this new fragment does not lead to a 
new computation of the pixel color, then no color data is 6. 
lost despite the replacement. 

[01 24] It is to be understood frat the above-describBd so 
embodiments are simply illustrative of the principles of 
the invention, "various other modifications and changes 
may be made by those stalled in the art which will 
embody the principles of the invention and fall within the 
scope thereof. 

Claims 

1„ A computerized method for rendering an image 
defined by pixels, comprising the steps of; 

selecting subpixel positions in a pixel as sam- 
ple points; 

storing a fragment value associated with a frag- 
ment of the image, the fragment covering at 
least one of the sample points; and 
linking each covered sample point to the stored 
fragment value to enable the generation of a 
color of the pixel using the fragment value, the 
generated color improving the perceived qual- 
ity of the image by reducing aliasing artifacts. 

2. The method of claim 1 . wherein the step of linking 
includes the steps of; 

associating an index with each covered sample 
point; and 

storing a value in each index that points to the 
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stored fragment valua 

The method of claim 1 . wherein the stBp of linking 
includes the steps of; 

associating a bit pattern with the stored frag- 
ment value, the bit pattern having a sequence 
of bits, each bit in the sequence being associ- 
ated with one of the sample points; and 
storing a value in each bit, the value in each bit 
indicating whether or not the sample point 
associated with that bit is covered by the frag- 
ment. 

The method of daim 1 further comprising the sitp 
of: 

partitioning the pixel into an array of subpixel 
positions, the array having N rows and N col- 
umns where N is an integer greater than one; 
and wherein each selected sample point is in a 
different row and in a different column th;in 
every other sample point in that pixel. 

The method of daim 1, wherein there are fewer 
sample points than subpixel positions in the pixel 

The method of claim 1 further comprising the stup 
of; 

allocating memory to the pixel for storing a pre- 
determined number of fragment values, the 
predetermined number being less than tie 
number of sample points in the pixel, further 
comprising the step of: 

determining whether memory is available 
for storing the fragment value by counthg 
links to each previously stored fragment 
value. 

The method of claim 1 further comprising the steps 
of: 

processing a new fragment having a new frag- 
ment value, the new fragment being visible at 
one or more of the sample points of the pbel; 
and 

replacing the stored fragment value with ihe 
new fragment value, further comprising ihe 
step of: 

computing a color for the pixel using he 
new fragment value and Bach stored frag- 
ment value before replacing the stored 
fragment value with the new fragment 
value. 
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8. The method of claim 1 lurther comprising the step 
of: 

reducing a number of sample points for the 
pixel when storing a fragment value associated s 
with s subsequent fragment would excised an 
amount of memory available for the pixel. 

9. The method of claim 1 further comprising the steps 

of: w 

selecting subpixel positions in a second pixel 
as sample points; and 

linking one of the sample points of the second 
pixel to the stored fragment value, is 

1 0. A method for reducing aliasing artifacts in an image 
defined by pixels comprising the 6teps of: 

selecting subpixel positions In a pixel as sam- 20 
pie points; 

determining that a new fragment of the image 
is visible at one or more of the sample points of 
the pixel, the new fragment having a new frag- 
ment value; 25 
allocating addresses of memory for the pixel for 
storing a predetermined number of fragment 
values; 

replacing a selected one of the stored fragment 
values with the new fragment value if the pre- so 
determined number of fragment values are 
already stored in the allocated memory when 
the new fragment is determined to be visible, 
otherwise, storing the new fragment value; 
linking each sample point of the pixel at which 
the new fragment is visible to the stored new 
fragment value to enable the generation of a 
color of the pixel using the fragment value, the 
generated color improving the perceived qual- 
ity of the image by reducing aliasing artifacts. 



1 1 . A memory for storing data used to compose a color 
for a pixel that is partitioned into subpixels, compris- 
ing: 

a plurality of addresses, each address storing a 
fragment value, each stored fragment value 
including a color value and being associated 
with a fragment of an image that is visible at 
one of the subpixels; and 
another address storing indices, each index 
being associated with one sub-pixel and includ- 
ing an index value that points to one of the plu- 
rality addresses storing a particular fragment 
value to link the subpixel associated with that 
index with the color value of the particular frag- 
ment value. 



12. An apparatus for rendering an image defined by 
pixels comprising: 

means for selecting subpixel positions in a pixel 
as sample points; 

means for storing a fragment value associated 
with a fragment of the image, the fragment cov- 
ering one or more of the sample points in the 
pixel; and 

means for linking each covered sample pcint to 
the stored fragment value to enable the ganer- 
ation of a color of the pixel using the fragment 
value, the generated color improving the per- 
ceived quality of the image by reducing aliasing 
artifacts. 

13. An apparatus for rendering an image defimxd by 
pixels comprising: 

a graphics device selecting subpixel positions 
in a pixel as sample points; and 
memory, coupled to the graphics device, stor- 
ing a fragment value associated with a frag- 
ment of the image, the fragment covering one 
or more of the sample points in the pixel, the 
graphics device linking each covered sample 
point of the pixel to the stored fragment value to 
enable the generation of a color of the pixel 
using the fragment value, the generated color 
improving the perceived quality of thB ima ge by 
reducing aliasing artifacts. 



35 



CO 



45 



50 



55 



13 



05/08/ 2 003 11:5 3 FAX 404 873 8501 



ARNALL GOLDEN & GREGORY 
EP 0 910 047 A2 



[g]020 




14 



05/08/2003 11:53 FA X 404 873 8501 



ARNALL GOLDEN & GREGORY 



11021 



EP 0 910 047 A2 



4X4 




206 ^ 200 m 



■201 201- 



• S4— 212 



S2 < 
— X 



S3 



N = 4 



S1 



FIG. 2A 



134 



8X8 



206 

H 1 



.202 220 




N = 8 



FIG. 2B 



134 206 



16X16 



-K 



204 



230 



■ss- 



-S13- 



SI- 



■ S9- 



•S3- 



■SB- 



X . . . -si4- 



-S10- 



•S8- 



-S16 



N = 16 



-232 



•S12- 



FIG. 2C 



15 



05/08 /2003 11:54 FAX 404 873 8501 



ARNALL GOLDEN & GREGORY 
EP 0 910 047 A2 



@i022 




16 



05/08/2003 11:54 FAX 404 873 8501 



ARNALL GOLDEN & GREGORY 
EP 0 910 047 A2 



[g023 




17 



05/08/2003 11:54 FAX 404 873 8501 



ARNALL GOLDEN & GREGORY 
EP 0 910 047 A2 



0024 




FIG. 5A 



18 



05/08/2003 11:54 FAX 404 873 8501 



ARNALL GOLDEN & GREGORY 
EP0910 047 A2 



@]025 




FIG. 5B 



19 




20 



05/08/2003 11:55 FAX 404 873 8501 



ARNALL GOLDEN & GREGORY 
EP 0 910 047 A2 



(2)027 




21 



05/08/2003 11:55 FAX 404 873 8501 



ARNALL GOLDEN & GREGORY 
EP 0 910 047 A2 



©028 



301- - 



602 




1 


0 


0 


0 









"31 6 




J. 



122 



314 



304 306 PIXEL MEMORY 



COLOR 


Z-DEPTH 


STENCIL 


304 306 308 




COLOR 


Z-DEPTH 


STENCIL 



GRAPHICS MEMORY 



FIG. 6B 



308 
310 



312 



22 



05/08/2003 11:55 FAX 404 873 8501 ARNALL GOLDEN & GREGORY 121029 



EPQ910 047 A2 




O 

CO 

d 



23 



05/08/2003 11:55 FAX 404 873 8501 



ARNALL GOLDEN & GREGORY 



0030 



EP 0 910 047 A2 




24 



05/08/2003 11:55 FAX 404 873 8501 



ARNALL GOLDEN & GREGORY 



121031 



EP 0910 047 A2 




£ 

PIXELS ARE 
READY FOR 
DISPLAY 



724 



SELECT NEW FRAGMENT 
AND COMPARE ITSZ£EPTH 
VALUE TO Z-DEPTH VALUE AT 
EACH SUBPIXEL SAMPLE 
OF A PIXEL 




INVALIDATE UNKS FOR SAMPLES 
COVERED BY NEW FRAGMENT 



I 



COUNT THE LINKS TO EACH 
STORED FRAGMENT TRIPLE 



-1^708 



COMPUTE PIXEL COLOR ' 72Q 



712 



r710 

^ ARE "V V 
^ANYTRIPLES> T 
.FREE?^ 



STORE NEVV 
FRAGMENTOOLOR 
IN FREE TRIPLE 



'716 



CHOOSE A TRIPLE 
COLOR TO REPLACE 



✓718 



SET SELECTED TRIPLE TO 
THE NEW FRAGENT COLOR 



SET APPROPRIATE LINKS FOR 
SAMPLES COVERED BY NEW 
FRAGMENT TO THE NEW COLOR 



714 



^720 



COMPUTE PIXEL COLOR 



FIG- 7 



25 



05/08/2003 11:56 FAX 404 873 8501 



ARNALL GOLDEN & GREGORY 



©032 



(12) 




Europaischas Patentamt 
European Patent Office 

nii EP 0 91 0 047 A3 

Office europeen des brevets (11) C r w ^ i w w 

EUROPEAN PATENT APPLICATION 

(51) mtci. 7 : G06T 15/10, G06T 15/50 



(8B) Date of publication A3: 

□7.02.2001 Bulletin 2001/06 

(43) Date of publication A2: 

21-04.1999 Bulletin 1999/16 

(21) Application number 98307790.0 

(22) Data of filing: 25.09.1998 



(84) Designated Contracting States; 

AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 
MCNLPTSE 

Designated Extension States: 
ALLTLV MICRO 61 

(3D) Priority: 15.10.1997 US 95B1 29 

(71) Applicant 

Compaq Computer Corporation 
Houston Texas 77070 (US) 



(72) Inventors: 

• Jouppl* Norman, P 

Palo Alto, California 94306 (US) 

• McCormack, Joel, M 
Boulder. Colorado 803O2 (US) 

(74) Representative: 

Charlg, Raymond Julian et al 
Eric Potter Clarkson, 
Park View House, 
58 The Ropewalk 
Nottingham NG1 5DD (GB) 



(54) Full-scene antialiasing using improved supersampling techniques 



(57) A method end an apparatus reduces aliasing 
artifacts in images defined by pixels. A pixel is parti- 
tioned into subpixel locations from which sample points 
are selected. A fragment of the Image is determined to 
be visible at least one of the sample points. A fragment 
value associated with that fragment is stored. Each 



sample point at which the fragment Is visible Is linked to 
the stored fragment value. A color of the pixel is com- 
puted from the stored fragment values to redice the 
aliasing artifacts In The image. 



CO 
< 

O 

o 

o> 
o 

Q. 

LU 




FIG. 1 



prtraod by Xwocr (UK) BUlM— Services 
2.10.7 lHRS)ft.n 



05/08/2003 11:56 FAX 404 873 8501 



ARNALL GOLDEN & GREGORY 



©033 



EP0 910 047 A3 



EUROPEAN SEARCH REPORT 



EP 98 30 7790 




CATEGOHY OF Off ED DOCUMENTS 



X ; torttuWy rvtovvfl « Itfan alow . 

Y • paitfcu tarty rrtB*mnl ■ cnn*»n»d *cn anoiiwr 

(ttcunwnl (he B«na cal«ff»y 
a : •atfinofagfc&l batlflmimd 



;, out puMtehod on. or 



T j ftttry or p**Jpb undartyng ino hvertkli ^ 
E : eartbr paionl documer*, t ' 

alter ita Mngotfa 
D : oocurrBRl clod bK* 
t : (tocumaoi did tor other mauns 



2 



05/08/2003 11:56 FAX 404 873 8501 



ARNALL GOLDEN & GREGORY 



@034 



EP 0 910 047 A3 



ANNEX TO THE EUROPEAN SEARCH REPORT 
ON EUROPEAN PATENT APPLICATION NO. 



EP 9B 30 7790 



This anna* lists the patent family mombers re lattto * the patent dacumonlB died in the abwe-menflon^d European search report. 

19-12-2000 



Patent document 
cited lh eaa/ch report 



Puclication 
dais 



Patanl family 
mernber(6) 



Publics lion 
dale 



W0 9741536 



06-11-1997 



EP 0463700 



02-01-1992 



US 
AU 
CA 
DE 
GB 
US 



GB 
GB 
OE 
DE 
JP 
KR 
US 
DE 
DE 
EP 
JP 
US 



5313456 A 
2824697 A 
2253297 A 
197B1737 T 
2328596 A 
5943060 A 



2245805 A 
2245306 A 
69127516 D 
69X27516 T 
4233086 A 
239969 B 
6088036 A 
69122557 D 
69122557 T 
0464907 A 
4233672 A 
5394516 A 



06-10-1998 
19-11-1997 
06-11-1997 
12-05-1999 
24-02-1999 
24-08-1999 



08-01- 

08- 01- 

09- 10- 
26-02- 
21-08- 
15-01- 
11-07- 
14-11- 
24-04- 
08-01 
21-08 
28-02 



1992 
1992 
1997 
-1998 
■1992 
-2000 
-2000 
-1996 
-1997 
-1992 
-1992 
-1995 



8 For mow details about Lhtc anno* ; we OmdaJ Journal Qf the Europe Patent Offiw, No. 12/B2 



3 



